Topologically Ordered Feature Extraction Based on Sparse Group Restricted Boltzmann Machines
نویسندگان
چکیده
منابع مشابه
Sparse Group Restricted Boltzmann Machines
Since learning in Boltzmann machines is typically quite slow, there is a need to restrict connections within hidden layers. However, the resulting states of hidden units exhibit statistical dependencies. Based on this observation, we propose using l1/l2 regularization upon the activation probabilities of hidden units in restricted Boltzmann machines to capture the local dependencies among hidde...
متن کاملSentiment-Aspect Extraction based on Restricted Boltzmann Machines
Aspect extraction and sentiment analysis of reviews are both important tasks in opinion mining. We propose a novel sentiment and aspect extraction model based on Restricted Boltzmann Machines to jointly address these two tasks in an unsupervised setting. This model reflects the generation process of reviews by introducing a heterogeneous structure into the hidden layer and incorporating informa...
متن کاملA novel feature extraction method for scene recognition based on Centered Convolutional Restricted Boltzmann Machines
Scene recognition is an important research topic in computer vision, while feature extraction is a key step of object recognition. Although classical Restricted Boltzmann machines (RBM) can efficiently represent complicated data, it is hard to handle large images due to its complexity in computation. In this paper, a novel feature extraction method, named Centered Convolutional Restricted Boltz...
متن کاملConvolutional Restricted Boltzmann Machines for Feature Learning
In this thesis, we present a method for learning problem-specific hierarchical features specialized for vision applications. Recently, a greedy layerwise learning mechanism has been proposed for tuning parameters of fully connected hierarchical networks. This approach views layers of a network as Restricted Boltzmann Machines (RBM), and trains them separately from the bottom layer upwards. We d...
متن کاملTemperature based Restricted Boltzmann Machines
Restricted Boltzmann machines (RBMs), which apply graphical models to learning probability distribution over a set of inputs, have attracted much attention recently since being proposed as building blocks of multi-layer learning systems called deep belief networks (DBNs). Note that temperature is a key factor of the Boltzmann distribution that RBMs originate from. However, none of existing sche...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Mathematical Problems in Engineering
سال: 2015
ISSN: 1024-123X,1563-5147
DOI: 10.1155/2015/267478